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The exact mean time between encounters of a given particle in a system consisting of many particles under- 
going random walks in discrete time is calculated, on both regular and complex networks. Analytical results are 
obtained both for independent walkers, where any number of walkers can occupy the same site, and for walkers 
with an exclusion interaction, when no site can contain more than one walker. These analytical results are then 
compared with numerical simulations, showing very good agreement. 
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The last decade has seen an explosion of interest in the 
properties and applications of complex networks with hetero- 
geneous structure, due to their importance for modelling ev- 
erything from social systems, such as the internet and net- 
works of acquaintances, to biological ones, such as genetic 
regulatory networks yj, |2[] . 

After much initial work on the structure of these networks, 
attention has now turned to dynamical processes which take 
place on them, with the aim of understanding the effect that 
different types of network structure have on the dynamical 
properties of a system JUS]. As representative examples in 
this direction, we mention studies on epidemics 0], the voter 
model and reaction-diffusion processes |0] occurring on 
complex networks. 

The properties of random walks on networks have also at- 
tracted much attention, both for single walkers 0, H, 01 and 
for multi-walker systems 11211 . These are perhaps the 

simplest systems involving motion of particles on networks, 
and hence are of interest to understand the effect of the net- 
work structure on diffusive properties such as mean transit 
time from one node to another, and the mean time to return 
to a given node U . 

These results have applications to individual-based mod- 
els, in which "agents" (particles with internal states) diffuse 
in space until they encounter each other, at which point they 
interact following model-specific rules. If the agents neither 
die nor reproduce, then one of the key quantities in the sys- 
tem is the time between these encounters, which we call the 
encounter time. 



An example is the Bonabeau model 11311 . in which agents 
represent animals which fight when they meet, with the win- 
ner and loser gaining or losing social status. This and sim- 
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ilar models | 14f| undergo a phase transition from a homoge- 
neous, non-differentiated society, to a society with two "social 
classes", one successful and one unsuccessful |[l3i [l5i [l6tl . 
One of the key features of the analysis in this model is the 
timescale given by the mean encounter time lfl5ll . 

Such models can also be studied on complex networks lfl7ll . 
Intuitively, for a complex network with highly-connected 
hubs, all walkers have a tendency to migrate towards the hubs, 
and thus they will encounter other walkers more frequently. 
The encounter time provides a quantitative measure of this ef- 
fect. 

Systems of many particles undergoing random walks on 
complex networks are so complicated that there are usually 
very few quantities which can be calculated exactly. Nonethe- 
less, in this paper, it is shown that the mean encounter time of 
a given walker in the system if often amenable to exact calcu- 
lation. 

To calculate such mean encounter times, encounters are 
viewed in terms of recurrences (or returns) to a set of en- 
counter configurations, and the Kac recurrence theorem is ap- 
plied. This theorem gives the exact recurrence time to a set 
in terms of its probability in equilibrium, that is, the proba- 
bility (frequency) of occupation of a set after the system has 
evolved for a long time and any transients have died away. For 
many random walkers on complex networks, even calculat- 
ing such equilibrium probabilities already requires some work 
lllltl - The calculation is also complicated by the necessity 
to carefully define when encounters occur. By carrying out 
these steps, we calculate equilibrium probabilities and mean 
encounter times for many random walkers with and without 
exclusion on regular and complex networks. 

The paper is structured as follows. In sec. HJ some nota- 
tion is introduced, and the main idea used in the paper is pre- 
sented, namely that encounter times may be expressed as re- 
currence times. Sections HH4IVI treat in turn the cases of in- 
dependent walkers on networks (regular or complex); regu- 
lar lattices with exclusion; and finally complex networks with 
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exclusion, which is the least tractable case. Section IVT1 gives 
conclusions. 



I. METHOD AND NOTATION 



We start by establishing some notation and describing the 
main technique to be used throughout this paper. 



A. Encounter times and recurrence times 



Calculating the mean encounter time thus reduces to the 
calculation of the equilibrium probability P eq (E) of the en- 
counter set. Note that higher moments and other features of 
the complete probability distribution of recurrence times are 
in general much harder to calculate |2(1 |2l|], and will not be 
addressed here. 

A special case is that of systems in which the transition 
probabilities P^y from one configuration, fi, to another, v, 
are symmetric, satisfying = P v ^/i- The condition of 

detailed balance, which holds throughout the paper, states that 
the flux of probability from jj. to v in equilibrium is equal to 
that in the reverse direction: 



We study a system of N particles undergoing random walks 
on a finite network. The network consists of V nodes, with 
edges joining them in a certain structure (see the next subsec- 
tion). We fix a distinguished walker and assign to it the label 
"0". The main question treated in this paper is how often this 
distinguished walker "interacts" with other walkers, that is, 
what are its encounter times x. These are defined as the time 
intervals between the moments at which the distinguished par- 
ticle meets (encounters) other walkers, measured in terms of 
steps per particle (a "sweep"). 

This random variable T has a certain distribution, which in 
general is quite complicated. In this paper, we consider exclu- 
sively its mean (t), which we call the mean encounter time of 
the distinguished walker. 

The key idea to calculate mean encounter times is the fol- 
lowing: encounters of a given walker correspond exactly to 
returns, or recurrences, to a particular set, namely the set E 
of configurations of the N walkers for which an encounter of 
walker occurs. A similar method was recently applied in a 
related context in ref . lfl2Tl . 

The spatial configuration of walkers is given by s := 
(s\ , . . . ,sn) specifying the location (site) sj of each walker j. 
To describe encounters, however, the spatial locations are not 
sufficient - we must also specify which walkers are chosen to 
interact at a given time. The rule for doing so is part of the 
definition of a given model. We call the combination of the 
spatial and interaction information an extended configuration. 

The mean encounter time (t) of walker is then given ex- 
actly by the mean recurrence time (t v £ c ) to the set E of ex- 
tended configurations corresponding to that walker's encoun- 
ters: (t) = (tJF). We can thus make use of the Kac recurrence 
theorem lfl8l fl9l l20l l2lll . which gives an exact result for the 
mean recurrence time (fjj 60 ) to a set A in an ergodic, discrete- 
time system, namely 



where P eq (A) is the probability that the system is in A in equi- 
librium. 



PfiP^v = PvPv^n- (2) 



Thus, systems with symmetric transition probabilities have 
equal equilibrium probability for all (accessible) configura- 
tions. In this case, the Kac result thus reduces to (l^ 60 ) = 
|£2|/|A|, where £2 is the set of all microscopic configurations 
of the system, and | ■ | denotes the cardinality (number of ele- 
ments) of its argument. 

Note that the encounter time as we have defined it above 
is a single-particle quantity. Since all walkers are equivalent, 
it may also be calculated by multiplying by N the mean in- 
terval between encounters involving any of the walkers in the 
system. 



B. Notation for network structure 



Throughout the paper, the fixed number of walkers is de- 
noted by N, the finite number of nodes in the undirected net- 
work by V, and the mean density of walkers per node by 
p := N/V. General references for network structure include 
refs. fflH. 

The sites of the network are labelled by i, and the degree 
(number of incident edges) of the site i is denoted by k\. The 
total number of sites in the network with degree A: is n^ := 
Yd^k-h an d tne degree distribution is then P(k) := n/ l /Y,k n k^ 
which is the probability that a randomly-chosen site has de- 
gree k. 

Finally, K := denotes the total number of outward 
edges in the network, which is twice the total number of undi- 
rected edges, since each is counted twice, and (k) := K/V is 
the mean number of incident edges per site, which satisfies 
K = V{k) zadN/K = p/(k). 
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II. INDEPENDENT WALKERS ON REGULAR AND 
COMPLEX NETWORKS 



The conceputally simplest case is that of many independent 
random walkers on regular or complex networks, with dynam- 
ics given as follows. At each time step, a single one of the N 
walkers is selected at random (uniformly). If this walker is at 
site i, then it chooses one of its kj neighbouring sites randomly 
(uniformly), and jumps to it. 

Under these dynamics, each walker is independent, and 
thus the known results for single walkers performing ran- 
dom walks on complex networks can be applied: each walker 
spends a proportion of time ki/K at node i 0.|2l|] (i.e., a time 
proportional to the degree of the node). Recall that K = 
is the total degree sum. 



A. Equilibrium distribution 



the following one is chosen. If the walker which moves lands 
at an unoccupied site, then no encounter occurs. If, however, 
the walker lands at a site containing m other particles, then 
the moving walker chooses exactly one of those m particles 
and interacts with it, i.e., each particle in this pair of walkers 
undergoes an encounter, but no other particle does so. This 
allows at most a single encounter at each time step, and forces 
the encounter to be a result of movement. 

Consider the set of encounter configurations defined after 
the walker has moved, and which contain information about 
which walker moved and which other walker (if any) is in- 
volved in the interaction, apart from the spatial positions of 
each walker. These encounter configurations are of two types: 
(i) those in which the distinguished walker was chosen to 
move, and it moved to a site which already contained at least 
one walker; and (ii) those in which a walker other than the 
distinguished one moved, this walker landed on the site which 
contains the distinguished walker, and furthermore the distin- 
guished walker was chosen as the interaction partner of the 
moving walker. 



First let us consider the exact equilibrium distribution of 
the occupation number at a site, i.e., the probability qi{m) of 
having m particles at a given site i of degree k(. Since the 
walkers are independent, and visit site i with probability pi = 
ki/K, the probability qi{rri) that site i has occupation number 
m is given by the following binomial distribution: 



qi{m) = 



N 

ml \K 



K 



N-n 



(3) 



The mean occupation number («,) of site i is then given by the 
mean of distribution: 



, > Nkj 
(ni)=Npi= — = flki, 



(4) 



where we have defined ji := p / (k). Thus (n,-) is proportional 
to kj. 



In each of these two cases, the probability that the dis- 
tinguished walker interacts is 1 /N times the probability that 
there is at least one other walker on the same site as the dis- 
tinguished walker after the jump. This is clear in case (i). 
For case (ii), suppose that there are m,- walkers at the site, 
one of which is the distinguished walker 0, but that was 
not the moving walker. Then one of the other m, — 1 parti- 
cles is the one that was chosen to move, with total probability 
(m,- — 1)/N, and after arriving at the new site an interaction 
was selected with the distinguished walkers 0, with probabil- 
ity 1 /(ra,- — 1). The total probability is the product of these, so 
we regain the same expression. 

It remains to calculate the probability that there is at least 
one other walker on the same site as the distinguished walker 
The equilibrium probability that the distinguished particle is 
on a given site ; with a total of m walkers at that site (including 
the distinguished one) is given by 



In the limit of infinite system size, V — ► °° with N — > °° but 
p := N/V fixed, we obtain asymptotically a Poisson distribu- 
tion: 

qi(m) ~ -^--(ixki) m exp(-ixki), (5) 
ml 

which is the approximate result obtained in (111]. 



B. Mean encounter time 



The mean encounter time of a distinguished walker, la- 
belled by 0, is calculated using the equilibrium probability 
P eq (E) of the walker's encounter set. When there is no exclu- 
sion, and several particles may occupy the same site, there are 
several possible definitions of when encounters occur; here, 



k l( N ' 
K \m- 



K 



(JV-l)-(m-l) 



(6) 



The term ki/K denotes the probability that the distinguished 
walker is at site i, the second term represents the fact that there 
are m — 1 other walkers at the same site, and the last term rep- 
resents the fact that the remaining N — m walkers are at some 
other site. The probability that the distinguished particle in- 
teracts is given by the previous expression multiplied by 2/N, 
provided m > 1 . 

The encounter probability if the distinguished particle is at 
site i can thus be calculated as 2/N times the probability that 
the distinguished particle is not alone at that site: 



2ki_ 
NK 



1-1- 



N-l 



(7) 
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The total encounter probability is then given by a sum over all 
sites i: 



2V 

eqV J NK L, ' 



1- 1-- 

K 



N-l 



(8) 



finally giving the exact result for the mean encounter time per 
particle: 



1 



2(k 



(9) 



Here, (■) k := ^[/"(fc)-] denotes the mean of its argument over 
the degree distribution. We have divided by N to give the 
physical time, such that each particle moves on average once 
per time step. Asymptotically for N — > °° with ji fixed, we 
obtain 



2(fe[l-exp(-MA:)]} s 



(10) 



For regular networks with constant coordination number z, 
the degree distribution is P(k) = 8(k — z). For such networks, 
we thus obtain 



V 7 2 



-r 



i 



2[l-exp(-p)]' 



(ID 



generally, we could allow the two interacting walkers to ex- 
change positions with (fixed) probability p exc h- The equilib- 
rium probability P eq (s), and hence also the mean encounter 
time (t), are unaffected by this. 



A. Mean encounter time 



1. Mean-field argument for encounter time 



The following simple mean-field argument has been used to 
estimate the mean encounter time in this system, in refs. lfl3l 



At each time step, a single walker moves, each with proba- 
bility 1/jV, so that the distinguished walker moves on average 
once every N steps. Suppose that the distinguished walker 
does move. The probability of an encounter is the probability 
that the site it jumps to (one of its z neighbours) is occupied, 
which is p, assuming that all walkers are distributed uniformly 
on the lattice (the mean-field assumption). Similarly, another 
walker can attempt to move to the site where walker is sit- 
ting. The total probability of the distinguished walker inter- 
acting is thus 2p, giving an estimate 



which is again independent of the coordination number z. 



(T>~l/(2p)=V/(2iV) 



(12) 



III. REGULAR NETWORKS WITH EXCLUSION 



We now turn to walkers interacting via an exclusion inter- 
action, so that each site can be occupied by at most one walker 
ifloll . In this section we consider the dynamics on a regu- 
lar network, i.e., one in which each site has the same degree 
(number of neighbours), denoted by z. The best-known sub- 
class of such networks consists of regular lattices; other reg- 
ular networks include small-world networks with a constant 
number of links per node. 

The dynamics are as follows. Initially, the walkers are dis- 
tributed uniformly on the lattice, but such that there is at most 
one walker at each site. The dynamics maintain this restric- 
tion, as for example in the Bonabeau model discussed in the 
introduction lfl3ll . and are defined as follows. At each time 
step, a walker is picked at random. This walker attempts to 
move to one of its z neighbouring sites, each with equal prob- 
ability. If the trial site is empty, then the walker moves to the 
new site. If the trial site is occupied by another walker, how- 
ever, then the walkers interact, an encounter occurs, and the 
invading particle remains where it is, without moving. 

Since the transition probabilities between two configura- 
tions are symmetric, all configurations s have the same equi- 
librium probability, P eq (s) = 1/|Q| = (V-N)\/V\. More 



for the mean encounter time per particle. We can refine this 
calculation by taking (N — 1)/(V — 1), rather than p, as the 
probability that the site jumped to is occupied, by condition- 
ing on the fact that the departure site is occupied. This gives 
(t) ~ (V - l)/2(N- 1). Note that this mean-field calculation 
is also appropriate for the dynamics without exclusion studied 
in the last section, in the case of a regular network. Indeed, 
expanding ( fTTT i for small p gives back this mean-field result. 

The above argument gives an (uncontrolled) approximation 
of the mean encounter time (t) on a lattice. It is not clear, 
however, how good an approximation it is. We now show 
that (t) can in fact be calculated exactly using the approach 
of section |T] The result of the (refined) mean-field calculation 
turns out to be exactly correct, suggesting that when we aver- 
age over all possible configurations of the particles, space "no 
longer matters". 



2. Exact calculation of encounter time 



For a regular network with exclusion, all microscopic con- 
figurations are equally likely, as shown above, so that the Kac 
recurrence theorem gives (t) = \£l\ / \E\ , where E again de- 
notes the encounter set of extended configurations for which 
the distinguished walker undergoes an encounter. 
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To calculate the mean encounter time (t) of a distinguished 
walker, we must first explicitly define the set E of encounter 
configurations. It is not initially clear how to do this, since 
two walkers can never occupy the same site. 

In fact, an encounter occurs exactly when the walker which 
is chosen to move does so towards an occupied site. To in- 
dicate this direction of motion, we augment the positional 
configuration of the particles s (before the move) with an 
arrow which sits on top of the moving walker and points 
in its chosen direction of motion - one of z possible direc- 
tions. The extended configurations thus take the form (s; w, d), 
where w G {1, . . . ,N} is the label of the moving walker and 
d £ {1, . . . ,z} is its chosen direction. 

The set £2 of all extended configurations is thus given by 
assigning to each of the N walkers a distinct site out of the 
V possible sites, choosing one of the N occupied sites as the 
moving walker, and then choosing one of z possible directions 
of motion. The total number of extended configurations is thus 



V! 



(V-N) 



;Nz. 



(13) 



An encounter involves the distinguished walker if either 
(i) walker is chosen to move, and it attempts to move towards 
an occupied site; or (ii) walker occupies the site towards 
which another walker attempts to move. The first requirement 
for the set E is thus that the distinguished walker has at least 
one neighbouring site occupied. 

We split the set E of encounter configurations of the dis- 
tinguished walker into disjoint sets E p , in which this walker 
has exactly p out of its z neighbouring sites occupied (with 
1 < p < z) and it actually does encounter a neighbouring 
walker, i.e., walker moves towards an occupied neighbour, 
or one of the particles in the neighbouring sites jump towards 
walker 0. Note that the sets E p do not fill up the whole of £2, 
due to these jumping conditions. 

The mean encounter time per particle of the distinguished 
walker is thus given by 



|Q1 

N\E\ 



mi 



(14) 



The calculation of the sizes \E p \ of the sets E p proceeds via 
the following combinatorial arguments. 

First consider E\, the configurations in which the distin- 
guished walker has a single occupied site and does en- 
counter its single neighbouring particle when one of them 
moves. Walker can be placed in any of the V sites; the 
single neighbour can then be chosen from the other (N — 1 ) 
walkers, and placed in any of the z neighbouring sites. The 
(N — 2) remaining walkers can be placed in any of the remain- 
ing (V— (z+ 1)) sites. Finally, only two configurations of the 
arrow are allowed: one which points from the distinguished 



walker to its single occupied neighbour, and another pointing 
from the neighbour to the distinguished walker. Thus 



2zV(N-\) 



[V-(z + l)}\ 



[V-(z+l)-(N-2)}\- 



(15) 



Similarly, when the site of the walker has p occupied 
neighbours we obtain 



E p =2pV 



(N-l)l [V-(z+l)}\ 

p) (N-i- P )![{v-N)-(z-p)y: 



(16) 



Here, the binomial coefficient (*) counts the number of ways 
of choosing the p neighbouring sites out of z to be occu- 
pied, the number of permutations Jf^zrjz \ gives the number 
of ways of placing p of the remaining (N — 1 ) walkers in those 
neighbouring sites, and the arrow can be in any of 2p config- 
urations. (These results remain valid for N close to or close 
to V if we define the permutations to be when the number to 
choose is greater than the number available.) 



The expression for \E p | may be rewritten as 

z-l\ fV-(z + l) 
p-l)\N-(p + l) 
1, we have 



\E p \=2Vz(N 
Thus, setting u := p 



1)! 



2Vz(N 
2Vz(N-l)\ 



1)1 1 

u=0 

V-2 
N-2 



z-l 
u 



V-(z-\ 
(N-2) 



1) 
- // 



(17) 



(18) 



(19) 



The equality in ( fT~9b comes from the interpretation of the sum 
in (fT8b as the number of ways of choosing (N — 2) boxes from 
a total of (V — 2), split into a choice of u from the first z — 1 
boxes, and the remaining (N — 2) — u from the V — (z + 1) 
remaining boxes. 



Finally, we obtain the exact result 

V-\ 



2(N-iy 



(20) 



Note that this is independent of the coordination number z, 
and hence is valid for any regular network. 

One might think that the independence under the dynamics 
of the Kac result would immediately show that the spatial and 
mean-field results are the same. In fact, however, the above 
argument shows that the sets of extended encounter configu- 
rations differ in each case, and so the argument is more in- 
volved - despite the simplicity of the final result, there does 
not appear to be a simpler derivation. 



B. Including a probability of interaction 



Within this same framework, we can allow for the possi- 
bility that actual encounters occur only a certain fraction p of 
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the time, even if particles meet. This could model a repulsion 
between agents, so that there is an unwillingess to interact, or 
a territory that is large enough so that two animals in the same 
coarse-grained cell move past each other without seeing each 
other. 

To calculate the mean encounter time in this case, the 
configurations may be extended further, taking the form 
(s;w,d,b), where the b are independent Boolean variables 
b G {0, 1} which indicate whether or not an encounter occurs. 

Denoting the new encounter set by E' := E x {1}, where 
{1} denotes when the Boolean variables are true, the result 
is P eq (£") = pP eq (E), and hence (t') = - (t), so that the ef- 
fect of including the probability p is an extra factor j in the 
expression for the mean encounter time, as is intuitively ex- 
pected. 



IV. COMPLEX NETWORKS WITH EXCLUSION 



In this section, we extend the results for many random 
walkers with an exclusion interaction to the case of complex 
networks, with heterogeneous degree distribution. The dy- 
namics is as follows. At each step, a walker is selected uni- 
formly. If the walker is at site i, then it attempts to jump to 
one of its neighbouring sites, with equal probabilities 1 /£,-. 
If the trial site is unoccupied, then the jump is allowed, and the 
particle is moved; if the trial site is occupied, then the jump is 
rejected, and the particle remains where it was. 

This case was previously studied in ref. ifioll by viewing the 
system as fermions and relating the equilibrium distribution of 
occupation numbers to the Fermi-Dirac distribution. Here we 
reconsider these results using a more intuitive method from 
ref. d. 

The combination of a heterogeneous network and the exclu- 
sion interaction makes the calculation of even the equilibrium 
occupation number distribution highly non-trivial; indeed, it 
does not appear to be possible to obtain simple, exact results 
for this quantity in general ifioll . In the next section we show 
that exact results can be obtained in the case of simple, struc- 
tured networks. In the following section we then give an ap- 
proximate argument valid for large networks. 



A. Small, structured networks 



For complex networks with some structure or which are 
small enough, it is possible to obtain exact results for the 
complete equilibrium distribution P eq (s) for each microscopic 
configuration s, and from there obtain coarse-grained quanti- 
ties such as the mean occupation number of a given node, by 
explicit calculation. Here we give a simple example, which 



illustrates the general method. 

We consider a star-shaped network, representing a single 
hub in a complex network. The network consists of a central 
site with L links to sites 1, . . . ,L, each of which has only a 
single link back to the hub. We consider two walkers moving 
with exclusion on this network, so that the possible configura- 
tions s are of the form s = (si , S2), where Sj is the site occupied 
by particle j, although the results are easily extended to more 
particles. There are two types of configuration: those with a 
particle at the hub, of the form s = (0,/) or (i,Q), of which 
there are 2L; and those with no particle at the hub, of the form 
s = with ij > 1 and ;' ^ j, of which there are L(L — 1). 



1. Equilibrium probability 



Let p : = P(i.j) be the equilibrium probability to be in config- 
uration with i 7^ and j ^ 0, i.e., with no particles at the 
hub). All probabilities are symmetric in the two arguments. 
The transition probabilities are given by 

P[(0,0-CM)] = ^; P[(j,i)^(0,i)] = \- (2D 

The second equation follows from the fact that there is a prob- 
ability 1/2 to move each particle from a configuration 
to arrive at the configuration (Q,i) or (7,0). From (y',0), with 
probability 1/2 the particle at site j is chosen, but it is unable 
to move due to the exclusion interaction and the presence of 
the other particle at the hub 0, which is the only site available. 
If the particle at the hub is chosen, then it moves to site i ^ j 
with probability l/L, 

The detailed balance condition 

p m P [(0, 1) -» CM)] = P(JA P -> (0, i)] (22) 

then shows that p(o,i) = Lp. Since the normalisation condition 
Ls 1% ( s ) = 1 must be satisfied, we have 

2L 2 p+L(L-l)p=l, (23) 

and hence p = 1/ (3L 2 — L). 

We have thus found the equilibrium probability P eq (s) of 
each configuration s. To find the mean occupation number 
(«,■} of site i, we must sum over configurations: 

<n,)=y>(s)P eq (s), (24) 

s 

where n, (s) is the occupation number of site i in the configu- 
ration s. In the case of exclusion, «, can only take the values 
and 1 , so that the mean occupation of the hub is given by a 
sum over those configurations s which have a particle in the 
hub, giving 

(n > = 2L 2 p. (25) 
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The mean occupation of a site i ^ is similarly given by a 
weighted sum over those configurations which have a particle 
in site ;: 

(«;) = Pa.Q) + P(o,i) + L [P(iJ) +PUJ)] < 26 ) 
/ i k& 

= 2Lp + 2(L-l)p=(4L-2)p. (27) 

The normalisation (no) +Lf=i ("i) = 2 is then correctly sat- 
isfied, and we have also checked these exact results with nu- 
merical simulations (not shown). 

In such structured networks, we can also proceed to obtain 
results for more detailed features of the probability distribu- 
tions, such as higher moments. 



Mean encounter time 



Identifying particle 1 as the distinguished walker, the prob- 
ability P eq (E) of its encounter set may be calculated in a sim- 
ilar way to that in sec. HII Al as the sum over all configurations 
such that 1 has a neighbour, weighted by the probability that 
an encounter occurs, i.e., that 1 interacts with the neighbour. 
In this simple system, encounters can occur only with con- 
figurations of the form (0,i) or (i',0), for which one of the 
particles is at the hub. In this case, the probability that the two 
particles interact is 1/2+1 /(2L), since the particle not at the 
hub always tries to jump towards the hub, whereas the particle 
at the hub usually jumps towards an empty node. 



giving 



?eq (£)=L[/>(;,o)+P(o,;)] 
= p(L 2 +L), 

I 

= 3- 



1 1 

2 + 2L 



P(L 2 +L) 



L+l 



(28) 
(29) 

(30) 



For a network with exclusion, the total number of spatial 
configurations is V!/(V — N)l, so that for arbitrary networks 
this kind of calculation becomes intractable. Nonetheless, for 
networks which are small and/or have enough structure it can 
be carried out relatively easily. 



B. Equilibrium distribution in the large-system approximation 



about a mean value, since in a finite system with a fixed num- 
ber of particles, the presence or absence of a particle at a site 
; affects the conditional probability to have a particle at site 
j 7^ i, given the occupation number of site i. 

To derive the equilibrium distribution in this approxima- 
tion, the method of ref. ifTHl can be applied. As shown below, 
the results which were first obtained in ref. ifioll are recovered, 
in a more direct way. 



1. Neighbouring sites 



Let pi be the probability that site i is occupied in equilib- 
rium. Due to the exclusion interaction, the occupation number 
«,■ of site i is either or 1, so that its mean is («,■) = /?,-. Thus 
Y,i Pi = N, the total number of particles present in the system. 

Suppose that the particle on site ; is chosen to move towards 
a neighbouring site j. The probability that the trial site is un- 
occupied is (1 — pi) under the independence approximation, 
and the probability that the direction towards site j is chosen 
is 1 jk-,. We thus obtain P^j = j^r(l — Pj)- 

Here the assumption of independence of occupation states 
has already been used. 

In equilibrium, the detailed balance condition p/Pj^j = 
PjPj^i gives 



jPi( l -Pj) = \-Pj{ l -Pi)- 



(31) 



Rearranging to collect all terms in p, and pj on opposite sides 
of the equation we see that 



Pj 



ki(l- Pi ) kj(l-pjy 



(32) 



and hence 



C. 



ki(l-Pi) 

where C is a site-independent constant. Finally we obtain 
Ch 1 



(33) 



Pi = 



l+Cki 1+Ak7 l 



(34) 



where A is another constant, as was found in ref. IK 
The constant A is determined by the normalisation condition 
Y,Pi = N, and thus depends on the entire set of degrees {ki}. 



For systems with many nodes, for which the above direct 
method is impractical, it is instead necessary to turn to an ap- 
proximation in which we assume that the occupation num- 
bers of neighbouring sites are independent fiol [Till . This is 
valid when the system is large, or in a grand-canonical situa- 
tion, where the number of particles in the system can fluctuate 



2. Single site 



A single-site variant of the above Markov chain method 
gives an alternative derivation. Consider a site i with degree 
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kj. Let Pq = 1 — pi and p\' = pj be the equilibrium proba- 
bility that the site is empty or occupied, respectively. We first 
need a mean-field type estimate of the transition probabilities 



from empty to occupied, PnL,\, and vice versa, P ] 



»(0 



Due to the way the network is constructed, following a 
given link from a given node leads to a new node j with proba- 
bility kj/K which depends on j, since node j has kj incoming 
edges lion . The particle at node j then jumps to site i with 
probability 1 / kj, giving Hill 



Ny K J kj N {k} 



(35) 



The second equality follows since Y.jPj = N an d N/K = 
p/(k)- 



and with the initial value ( 1381 for A: 



= ^1^(1-^); 



i 



pi : = 



l +Awkj 



giving 



A («+l) = 



[aW]- 



(39) 



(40) 



(41) 



This iteration, which is easily implemented computationally, 
quickly converges to a fixed point which gives the numerically 
exact value of A and of the pj for the given degree sequence, 
and thus provides an alternative numerical method to that used 
inref. Q3|. 



We calculate Pj_, by arguing similarly. If the particle at 
site i is selected, with probability 1 /N, then it can attempt to 
move to any of the kj neighbours, each with probability 1 /kj. 
The neighbour is site j with probability kj/K. The move is 
successful only if the neighbour is empty, due to the exclusion, 
and occurs with probability 1 — pj, giving 



1 kj 



N ; K 



(36) 



Note the extra factor (1 — pj) compared to the expression for 
independent dynamics in ref. fiUl . 



Detailed balance gives (1 —pi)P}P 



j(0 



[ — pjP^ , from which 
we finally obtain (134-b again, but now with an expression for 
A: 



Although this equation appears to give new information, in 
fact it turns out to be equivalent to the normalisation condition. 

Unfortunately, it does not seem to be possible to solve this 
equation exactly to find A and the pi explicitly. In ref. JlQIl , A 
was found numerically by solving the normalisation equation 
Y,j Pj = N. This gives no insight into the quantity A, however. 

An alternative is to find approximations to A. A first ap- 
proximation is obtained by taking all ki equal to (k) in d37l ). 
giving 



A (0) 



1-P 



(*>• 



(38) 



As shown below in fig. [2] this already gives a reasonable ap- 
proximation to the distribution /?,- for networks for which the 
deviation of the kj from their mean is small, although the cor- 
responding /?|°' calculated using this value for A do not satisfy 
the normalisation condition. 



C. Mean encounter time in the large-system approximation 



The calculation of the mean encounter time in the large- 
system approximation, supposing that the occupation proba- 
bilities of neighbouring sites are independent of each other, 
proceeds as follows.. 

For the distinguished walker to have an encounter, it first 
must be at some site ;, which occurs with probability pj/N 
(giving a total probability 1 to be at some site). There are two 
possibilities for such encounters: either walker is chosen 
to jump, in which case it has an encounter if the trial site is 
occupied, or another walker attempts to jump onto the site 
occupied by walker 0. 

The probabilities for these two possibilities are calculated 
in the same way as the transition probabilities in the previous 
section. Again denoting by E the encounter set of the distin- 
guished walker, we obtain 



cq 



N 



and hence 



pkPr 



k '^kj 



V(k) 



K 



Pj- 



(42) 



(43) 



2l lj k j pj 

We remark that this calculation is basically that of the jam- 
ming probability studied in ref. Holl . i.e., the probability that 
the particle which attempts to move is jammed (blocked) HT 
- that is, that an encounter occurs. 



V. NUMERICAL RESULTS 



Further approximations may be obtained - either analyti- 
cally or numerically - by an iterative scheme based on (T3"7l i 



In this section, the analytical results obtained in previous 
sections are compared with the results of numerical Simula- 
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0.2 0.4 0.6 0.8 1 

density p 

FIG. 1: Mean encounter time N (t) on a linear chain of length V = 
100, as a function of the number of particles N, with and without 
exclusion. Numerical results, evaluated as a mean over 10 8 steps, 
are compared to the analytical results; lines are shown as a guide 
for the eye. Error bars are of the order of the symbol size. There is 
excellent agreement in both cases. Dashed lines show the asymptotic 
behaviour. 



tions on two different types of network, one regular and one 
complex. 



A. Regular network: linear chain 



First consider a regular network, consisting of a linear chain 
of V — 100 sites, where each site is connected to its two near- 
est neighbours, with periodic boundary conditions. 

The mean encounter time of a distinguished walker for dy- 
namics both with and without exclusion on this chain are 
shown in fig. Q] as a function of the total number of walkers, 
N, between 2 and V. To distinguish the two cases, the time is 
shown as N (t), i.e., as a raw number of steps, rather than as 
a number of sweeps. The analytical and numerical results in 
both cases agree very well. 

The figure shows that the mean encounter time (in sweeps) 
depends very little on the dynamics. The mean encounter time 
in the case of exclusion dynamics is generally slightly shorter, 
which we can attribute to the fact that the particles must be 
spread out more uniformly through the system in this case due 
to the exclusion interaction. 

Note that at first glance the Kac result ( |20l does not hold for 
a one-dimensional dynamics with strict exclusion, since this 
result assumes ergodicity, i.e., that it any configuration can be 
reached from any other, which is not the case due to the one- 
dimensional nature of the system: each walker is always con- 
fined between the same two neighbours. However, the result 



h 

--H:;;.:::^ 

exclusion 



20 40 60 80 100 120 140 160 

ki 

FIG. 2: Mean occupation number {«,■) for each site i, as a function 
of the degree k, of the site, for dynamics with and without exclu- 
sion, on a single random network with power-law degree distribution 
P(k) ~ k~ a with a = 2.5. The network has V = 1000 nodes and 
mean degree (k) = 5.036. The numerical data for each site is shown 
as a symbol, and the curves show the analytical results; the lowest 
curve is the zeroth-order approximation p, (0) in the exclusion case. 
The complete curve in the case of independent dynamics continues 
to grow linearly for larger kj (not shown). 

is in fact valid. This is because the mean encounter time is a 
single-particle quantity, which can be calculated by averaging 
over all particles in the system. The result for the global en- 
counter time (taking into account encounters of any particle) 
will be the same in the ergodic and non-ergodic cases, since 
each time between two encounters is unaffected, but may be 
assigned to a different walker. This then implies equality also 
for the encounter times of a distinguished walker. 



B. Complex networks: random graphs with power-law degree 
distributions 



The second case is that of random networks with a power- 
law degree distribution P(k) ~ k~ a . These are generated ac- 
cording to the prescription in ref. l22ll : (i) a degree sequence 
(^i')Li i s generated from the distribution, rejecting each ki if it 
does not satisfy 2 < < N; (ii) ki "stubs" are generated at each 
node i; and (iii) pairs of stubs are chosen at random to be con- 
nected. This method gives networks which in general include 
self-links from a given node back to itself, as well as multi- 
ple links between nodes l23ll . Since both the random- walk 
dynamics and our analytical results take these into account, 
no attempt was made to remove them from the network, as is 
done in ref. 12311 for example; rather, this gives a more strin- 
gent test of the analytical results. The imposed minimum de- 
gree of 2 at each node ensures that the resulting network is 
connected with probability one l23ll . 

Power-law networks with smaller values of a have more 
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FIG. 3: (a) Mean encounter time (t) of a distinguished walker on networks with power-law degree distribution P(k) ~ k~ a , for different values 
of a with V = 1000 sites and for a chain with V = 100, as a function of the density, p. Only data for exclusion dynamics are shown; data for 
independent walkers are very close to these. To highlight the differences between the curves, (b) shows 1/ (t) for different a compared to the 
analytical results, drawn with black dotted lines. The lowest dashed line shows the mean-field result for comparison. 



nodes of high degree, and in particular a few very highly- 
connected hubs. Particles will concentrate at or near these 
hubs, and so intuitively this will lead to shorter mean en- 
counter times. For an infinite system, the degree distribution 
has a well-defined mean if and only if a > 2, but for a finite 
network we can also consider a < 2. We do, however, impose 
the total number of sites as a cutoff for the maximum allowed 
degree. 

Figure [2] shows a comparison of numerical and analytical 
results for the mean occupation number («,) (which is equal 
to pi in the case of exclusion dynamics) in the case a = 2.5, 
for dynamics with and without exclusion. We see that the 
zeroth-order approximation p,(0) already provides a good ap- 
proximation for exclusion dynamics, even though the values 
of ki cover a wide range of values, including far from the mean 
(k). The converged p; agree very well indeed with the numer- 
ical values, as was already found in ref. ifToll . 

Figure[3]shows the mean encounter times for networks with 
different power-law degree distributions. Part (a) shows (t), 
and part (b) shows 1 / (t) to exhibit more clearly the dif- 
ferences between networks with different a. The main ob- 
servation is that networks with smaller a, i.e., with highly- 
connected hubs, indeed have lower mean encounter times. 
This is highlighted in |4j where the encounter time is plotted 
for different values of p as a function of a. We also see that 
the exact and numerical results again agree very well. Results 
for non-exclusion dynamics on the same graphs are very sim- 
ilar, although slightly larger, for the same reason as in regular 
networks, and are not shown. 
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FIG. 4: Mean encounter time (t) as a function of the power-law 
exponent a, for different densities p, on networks of size V = 1000. 
The black dotted lines show the analytical results for comparison. 



VI. CONCLUSIONS 



In conclusion, this paper has shown that it is often possi- 
ble to calculate analytically a key quantity in systems con- 
sisting of many interacting random walkers, namely the mean 
encounter time of a given particle. This was carried out for 
the case of independent walkers and for walkers with exclu- 
sion on regular and complex networks, and the results were 
successfully compared to numerical simulations. 

For a given graph, the mean encounter time is very simi- 
lar whether dynamics with or without exclusion is used, even 
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though the mean occupation numbers can be quite different. 
This could change with a different choice of interaction rule 
in the case of independent walkers. 

At first glance, it seems that the results require averages 
over a very long time to be valid, namely the time required 
for a given walker to explore the whole system. In the case 
of a high-density system with exclusion, for example, this 
timescale could be very long. In fact, however, the results 
are unaffected by considering interacting particles which ex- 
change positions, so that the timescale required is more like 
that for a single particle to explore the system when no others 
are present. 

The method employed can be extended to other mean en- 
counter times of interest. For example, interaction times be- 
tween two distinguished walkers can be found. The extension 
of these results to higher moments and the full probability dis- 
tribution of encounter times, and the effect of different net- 
work structures on those results, are subjects for future study. 

The author thanks G. Naumis for suggesting to study the 
Bonabeau model, M. Aldana for a helpful conversation, and 
H. Larralde for useful discussions and for a reading the 
manuscript critically. Financial support from the PROFIP pro- 
gram of DGAPA-UNAM is acknowledged. 



intuition about why the result should be true. Here, a simple, 
non-rigorous argument is given which captures the essence of 
the result. 

To find the mean recurrence time (Tjj ec ) to a set A in a 
discrete-time, ergodic system, consider a long trajectory of 
the system, of length T time steps. If at time t the system is in 
A, then write a 1; if it is outside A, then write a 0, thus coding 
the trajectory as a symbol sequence of 0s and Is. 

At long times, T — > °°, the proportion of Is in the sequence 
converges to the equilibrium probability P eq (A) that the sys- 
tem is inside A. This is the crucial part of the argument. From 
a physical point of view, it is a weak version of the Boltzmann 
ergodic hypothesis, but in the case of discrete-time stochastic 
proc esses it is made rigorous by the Kac recurrence theorem 
iflal . The number of Is occurring in time T is thus roughly 
rP eq (A). Similarly, the total time spent outside A is approxi- 
mately T [l - Peq (A)]. 

Now consider rearranging the list of Is and 0s so that ap- 
proximately the same number of 0s occurs between each pair 
of consecutive Is. The mean recurrence time is then this num- 
ber of 0s, plus 1 for the extra step to return to the next 1, giving 



APPENDIX A: INTUITIVE DERIVATION OF THE KAC 
RECURRENCE THEOREM 



rcc\ 
'A ) 



= 1 



r[i-P eq (A)]_ i 



T¥ eq (A) P eq (A)' 



(Al) 



Rigorous derivations of the Kac recurrence theorem, such 
as can be found in refs. lfl8l [l9i l20ll . do not always provide 



which is the Kac result. 



[1] R. Albert and A. Barabasi, Rev. Mod. Phys. 74, 47 (2002). 

[2] M. E. J. Newman, SIAM Review 45, 167 (2003). 

[3] A. Barrat, M. Barthlemy, and A. Vespignani, Dynamical Pro- 
cesses on Complex Networks (Cambridge University Press, 
2008). 

[4] M. Boguna, R. Pastor-Satorras, and A. Vespignani, Phys. Rev. 

Lett. 90, 028701 (2003). 
[5] V. Sood and S. Redner, Phys. Rev. Lett. 94, 178701 (2005). 
[6] V. Colizza, R. Pastor-Satorras, and A. Vespignani, Nature Phys. 

3, 276 (2007). 

[7] J. D. Noh and H. Rieger, Phys. Rev. Lett. 92, 1 18701 (2004). 
[8] S. Condamin, O. Benichou, V. Tejedor, R. Voituriez, and 

J. Klafter, Nature 450, 77 (2007). 
[9] E. M. Bollt and D. ben-Avraham, New J. Phys. 7, 26 (2005). 
[10] A. P. S. de Moura, Phys. Rev. E 71, 066114 (2005). 
[1 1] M. Maragakis, S. Carmi, D. ben-Avraham, S. Havlin, and P. Ar- 

gyrakis, Phys. Rev. E 77, 020103 (2008). 
[12] D. P. Sanders and H. Larralde, Europhys. Lett. 82, 40005 
(2008). 

[13] E. Bonabeau, G. Theraulaz, and J. Deneubourg, Physica A 217, 



373 (1995). 

[14] E. Ben-Nairn and S. Redner, J. Stat. Mech. 2005, LI 1002 
(2005). 

[15] T. Okubo and T. Odagaki, Phys. Rev. E 76, 036105 (2007). 
[16] G. Naumis, M. del Castillo-Mussot, L. Perez, and G. Vazquez, 

Physica A 369, 789 (2006). 
[17] L. K. Gallos, Int. J. Mod. Phys. C 16, 1329 (2005). 
[18] M. Kac, Bull. Amer. Math. Soc. 53, 1002 (1947). 
[19] M. Kac, Probability and Related Topics in Physical Sciences 

(American Mathematical Society, 1959). 
[20] S. Condamin, O. Benichou, and M. Moreau, Phys. Rev. E 75, 

021111 (2007). 

[21] D. Aldous and J. A. Fill, Reversible Markov Chains and 
Random Walks on Graphs (1999), available online at 
Ihttp : //www. stat .berkeley.edu/~aldous/RWG/book . html 



[22] M. E. J. Newman, S. H. Strogatz, and D. J. Watts, Phys. Rev. E 

64, 026118 (2001). 
[23] M. Catanzaro, M. Boguna, and R. Pastor-Satorras, Phys. Rev. E 

71, 027103 (2005). 



